Tactile user interface

ABSTRACT

A virtual user interface including: a display screen; a masking means for concealing at least part of said screen and revealing at least one preselected display area; at least one user-actuated control; and control means responsive to said user-actuated control for displaying information on said display area operatively associated with said user-actuated control.

RELATED APPLICATIONS

The present invention is a National Filing in the U.S. under 35 USC 371of International (PCT) Application No. PCT/AU2006/001463, Request filed5 Oct. 2006, published as WO 2007/134359 A1 on 29 Nov. 2007. Thecontents of such PCT Application No. PCT/AU2006/001463 are incorporatedherein by reference.

International (PCT) Application No. PCT/AU2006/001463 claims priority ofAustralian Application No. 2006902752 filed 22 May 2006 to ApplicantFairlight.AU Pty Ltd. of Australia. The contents of such AustralianApplication No. 2006902752 are incorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates to user interface devices and inparticular to screen based user interfaces.

The invention has been developed primarily for use as a user interfacedevice for control of media applications such as audio and video andwill be described hereinafter with reference to this application.However, it will be appreciated that the invention is not limited tothis particular field of use and applies where any user interface toequipment is required.

BACKGROUND OF THE INVENTION

Any discussion of the prior art throughout the specification should inno way be considered as an admission that such prior art is widely knownor forms part of the common general knowledge in the field.

User interfaces for interaction with machinery are well know. Fromcomputer keyboard and display to large music panel type devices, thesearrangements are in common use in society. Various advances have alsobeen made. For example, a known user interface devices includes theprototype Optimus keyboard. Each of the keys on the Optimus keyboard hasa discrete display showing the function of the key at that moment. Whenthe function of the key changes, the display on the key changes to thenew function of that key. This helps the user to quickly adjust tocontrolling new programs or devices however it is relatively expensivetechnology limited to depressible OLED keys.

SUMMARY OF THE INVENTION

It is an object of the invention in its preferred form to provide avirtual user interface with adaptable display means consisting ofrelatively inexpensive technology.

According to a first aspect of the present invention there is provided avirtual user interface including:

a display screen;

masking means for concealing at least part of the screen and revealingat least one preselected display area;

at least one user-actuated control; and

control means responsive to the user-actuated control for displayinginformation on the display area operatively associated with theuser-actuated control.

Preferably, one display area is a display window and one user-actuatedcontrol is a switch for manipulating information displayed on thedisplay window.

Preferably, another display area is a switch display for indicating thecurrent function of the switch. The switch display is preferablyinstantaneously changeable in correspondence with a change in thefunction of the switch. Preferably, there is an image conduit forconveying information from the switch display to a location spaced fromthe screen. The image conduit preferably includes a plurality of opticalfibres. Preferably, switch includes a translucent cap adjacent one endof the image conduit for displaying the information from the imageconduit.

Preferably, the control means is mounted on a printed circuit board(PCB). The switch is preferably depressible mounted on the PCB.

Preferably, the switch is located directly above the switch display. Theswitch preferably includes a silicon keymat attached to the cap, thekeymat including at least one primary electronically conductive switchcontact such that depression of the cap causes electrically transmissivecontact between the primary switch contact and a corresponding basecontact on the PCB for activating the function displayed on the switchdisplay. Preferably, the keymat includes at least one secondaryelectronically conductive switch contact at a different height from theprimary switch contact such that the velocity of depression of theswitch can be measured. Preferably, the primary and secondary switchcontacts are conductive carbon pills.

Preferably, one user-actuated control is a knob for manipulating theinformation displayed on the display window. The knob is preferablyrotatably mounted. Preferably, the knob includes indicating meansengaging a sensor on the PCB for translating rotational movement of theknob to the PCB. The indicating means are preferably a pair of lightemitting diodes (LED's) and receivers.

Preferably, one display area is a knob display for indicating thecurrent function and status of the knob. The knob display is preferablyadjacent the knob. Preferably, there is included a light conduit formedby a slot in the PCB directly above the knob display for conveyinginformation from the knob display to a location spaced from the screen.The knob is adjacent the display window such that a portion of thedisplay window closet to the knob is the knob display.

Preferably, one user-actuated control is a touch, position or pressuresensor mounted over the display window.

Preferably, the masking means includes a protective product surface.

BRIEF DESCRIPTION OF THE DRAWINGS

A preferred embodiment of the invention will now be described, by way ofexample only, with reference to the accompanying drawings in which:

FIG. 1 is a top view of a portion of virtual user interface according tothe invention;

FIG. 2 is a sectional view taken on the line A-A of FIG. 1;

FIG. 3 is a sectional view taken on the line B-B of FIG. 1;

FIG. 4 is a sectional view taken on the line C-C of FIG. 1;

FIG. 5 is a top view of one arrangement of a knob and knob display;

FIG. 6 is a sectional view taken on the line A-A of FIG. 5;

FIG. 7 is a top view of a second arrangement of a knob and knob display;

FIG. 8 is a sectional view taken on the line A-A of FIG. 7;

FIG. 9 is a top view of a third arrangement of a knob and knob display;

FIG. 10 is a sectional view taken on the line A-A of FIG. 9;

FIG. 11 is a top view of a fourth arrangement of a knob and knobdisplay;

FIG. 12 is a sectional view taken on the line A-A of FIG. 11; and

FIG. 13 is a sectional view of a modified embodiment having key velocitymeasurement capabilities.

PREFERRED EMBODIMENT OF THE INVENTION

Referring to the drawings, the virtual user interface includes a thinfilm transistor screen covered by a masking means for concealing atleast part of the screen and revealing at least one preselected displayarea. A control means is located adjacent the screen and is responsiveto the user-actuated control for displaying information on the displayarea operatively associated with the user-actuated control. The controlmeans is mounted on a printed circuit board (PCB) having preselectedholes and slots cut in to house user-actuated controls and displayareas. The printed circuit board also forms part of the masking means.

One of the display areas is a display window and one user-actuatedcontrol is a switch for manipulating information displayed on thedisplay window. Another display area is an instantaneously changeableswitch display including an image conduit having a plurality of opticalfibres for conveying the current switch function from the switch displayto a location spaced from the screen. The switch is mounted to the PCBhaving a translucent cap adjacent one end of the image conduit fordisplaying the information from the image conduit. The switch is locateddirectly above the switch display.

The switch includes a silicon keymat attached to the cap, the keymathaving one set of primary electronically conductive switch contacts inthe form of conductive carbon pills. The arrangement is such thatdepression of the cap causes electrically transmissive contact betweenthe primary carbon pills and a corresponding base contact in the form ofcopper tracks on the PCB thereby activating the function displayed onthe switch display. Alternatively, the carbon pill creates anelectrically transmissive contact between two tracks on the PCB.Furthermore, the keymat can have a set of secondary conductive carbonpills arranged at a different height to the primary carbon pills suchthat the velocity of depression of the switch can be measured and usedas an additional parameter.

In other less-preferred configurations, the switch may be slidablymounted between two or more positions. The switch display may also belocated adjacent the switch.

Another user-actuated control is a knob rotatably mounted on the PCB formanipulating the information displayed on the display window. The knobincludes indicating means in the form of a pair of light emitting diodes(LED's) engaging a sensor on the PCB for translating rotational movementof the knob to the PCB. Furthermore, an optional touch sensor circuitcould be connected to the knob.

Another display area is a knob display adjacent the knob for indicatingthe current function and status of the knob. A light conduit is formedby a slot in the PCB directly above the knob display for conveyinginformation from the knob display to a location spaced from the screen.One arrangement has another display window formed substantiallysurrounding the knob as shown in FIG. 6. An alternative configurationhas the knob adjacent the display window such that the knob display isthe portion of the display window closet to the knob seen in FIG. 8.Other functional indicators for the knob include light guides disposedabout the knob as shown in FIG. 10 or an alphanumeric display adjacentthe knob as shown in FIG. 11.

A third form of user-actuated control is a touch sensor mounted over thedisplay window. This clear sensor allows chosen items on the displaywindow to simply be pointed to and engaged with a finger or otherpointing article to manipulate the displayed information.

The masking means includes a protective product surface typically anopaque moulded plastics shape. The product surface contains holes andslots in correspondence with the PCB. Suitable alternative protectivematerials for the product surface include sheet metal, punched and bentinto shape.

It will be appreciated that the illustrated virtual user interface hasadaptable display means consisting of relatively inexpensive technology.The TFT-Based User Interface Device provides a flexible and inexpensivearchitecture for creating user interface devices for real-time controlof media applications such as audio and video. It incorporates the threemost important user controls in media applications, namely switches,rotary knobs and display areas, and it provides the graphical supportneeded for labelling and tallying the actions of these devices. Becauseof the built-in computer graphics, the switches and rotary knobs can beassigned different functions depending on operational context, and userscan easily see what function is current for each device. In addition,the graphics can tally the values of parameters controlled by switchesand rotary knobs, in close proximity to the control itself. Thecombination of these facilities reduces the surface area needed todesign a user interface for a specific purpose, thus lowering its costand enhancing its value in environments such as production studios,where real estate is at a premium.

Turning initially to FIG. 1, there is illustrated a TFT-Based UserInterface Device of the preferred embodiment which consists of anunderlying TFT screen 1 with a number of objects mounted on top of it.The screen 1 displays computer-generated graphics, while the objectsmounted on top provide three types of user control:

1. Tactile Switch with programmable inset display 3

2. Rotary Knob with optional display 4

3. Display Window 5

This device makes use of the fact that the underlying TFT screen can beprogrammed with complete flexibility, so that one part 5 of it canappear to the user to be a self-contained display device, while othersform other displays and labels. The device can also re-program itselfaccording to the task that the user is currently undertaking, bychanging the labelling of switches accordingly. Further, groups ofcontrols can be created, by using different colours of backgrounds.Internationalisation can easily be achieved, where keys can show letters& symbols in the native language. Icons can be used instead for text,for a more intuitive display. The core components listed above canthemselves be used in different physicals, application specific,configurations. One low-cost TFT device, coupled with standard sets ofcomponents comprising the three user controls, can form the hardwarebasis of any user interface design, simply by changing the placement ofthose components. The preferred embodiment provides for increased speedof operation and better ergonomics through switches always being closeat hand.

Turning now to FIG. 2 there is shown a sectional view of the preferredembodiment through the line C-C of FIG. 1 revealing the major parts ofthe preferred embodiment. These include:

TFT Screen 1: The TFT screen is a standard device, available in a numberof sizes and pixel resolutions. It is capable of displaying images withthousands of colours, and redrawing them fast enough to achieve smoothanimation.

Product Surface 2: The product surface is typically an opaque mouldedplastic shape, mounted above the TFT screen 1. It contains holes e.g. 6where switches 3, knobs 4 and display windows 5 can be mounted, and canbe moulded where needed for assembly of these components. Alternativeimplementations could use sheet metal, punched and bent into shape.

Printed Circuit Board 8: The printed circuit board is used to mount theswitch and rotary knob electronics. It has holes and slots cut in itwhere needed to reveal the TFT screen and mount components such as theswitch assembly light conduits. The printed circuit board 8 containscopper tracks used by the Switch Assembly, and the LEDs and theircorresponding sensors, which are used by the Rotary Knob assembly. Itmay also contain power supplies, graphics drivers, processing for thesensor decoding, and interfacing to a host computer.

Display Window 5: The Display Window frames and reveals a part of theTFT screen, to be used as a viewing area. Its function is to displayneeded contextual information to the user, including parameter values,mode statuses, typed input, graphic display of media content such asaudio waveforms and transfer function graphs, and any other informationneeded by the user. Part of the Display Window forms an opaque framearound the Viewing Area (FIG. 3). This part is moulded into the ProductSurface. The other part is a clear plastic covering which protects thesurface of the TFT screen and allows light to pass through. Optionally,the display window can be fitted with a touch-sensor. Differentestablished designs of touch overlays are commercially available,including resistive, capacitive and acoustic.

Particular devices utilised as part of the display will now be describedin more detail.

Rotary Knob Assembly 4

The Rotary knob assembly 4 mounts at any desired position in and is heldby the Product Surface. It combines a simple manually operated turningmechanism with a rotation detection system. The detail of the RotaryKnob Assembly 4 is shown in FIG. 3. The assembly includes an outer knob10 which is interconnected to a shaft 11 which is held in place withinbush 13 by means of retaining clip 12. The degree of rotation ismonitored by two LEDs e.g. 16, shining through slots in the cylindricalbase of the shaft 11 and their respective receivers. These are detectedby a sensor 15 mounted on the Printed Circuit Board, producing acharacteristic square wave output pattern which can be used to detectthe direction and angle of any rotational movement.

If desired, the Printed Circuit Board and Product Surface can have slotsor other shapes routed out to allow light from the TFT screen to travelupwards through a light conduit and appear in proximity to the rotaryknob. This can be used to indicate the status and value of the parameterbeing controlled by the knob at any time. A first such arrangement isillustrated in FIG. 5 and FIG. 6 wherein a series of light guides 20 arearranged around a rotary knob 21. FIG. 7 and FIG. 8 illustrates a secondexample where a display is provided adjacent the knob 26. As will bediscussed in more detail hereinafter, the display includes an imageconduit 27, taking the image from the TFT to the display window.

Similarly the knobs can be mounted at the edge of a Display Window,where an adjacent small area can be devoted to depiction of the knob'scontextual function, status and value at any time. Such an arrangementis illustrated in FIG. 9 to FIG. 12.

Switch Assembly 3

Returning to FIG. 1, there is illustrated a Switch Assembly 3. Theswitch assembly is also illustrated in section in FIG. 2. The switchoperation uses a single silicon keymat 30 with conductive carbon pills31, into which is mounted a clear plastic Key Cap 32 that is pressed bythe user. The downward movement causes the carbon pill to reach and makecontact with copper tracks on the Printed Circuit board 8, completing anelectrical circuit.

The Image Conduit 34 is a block of material filled with parallel opticfibres, which is located in contact with the TFT screen 5. Light fromthe screen travels upwards to the top of the Image Conduit, which ishoused inside the clear Key Cap 32. Thus it appears that the light is atthe top of the key. The Image Conduit remains in a fixed position, incontact with the TFT screen, even while the Key Cap moves up and down.This ensures that the light entering it is strong and focussed. Thevertical movement of the Key Cap 32 is kept to the minimum needed foracceptable user “feel”, so that the lighted top of the Image Conduit isnever too far below its top. This ensures that the light image caneasily by read, regardless of the user's viewing position.

The small area of the TFT 5 immediately below the Image Conduit 34 canbe programmed to create a label for the switch. Its text or iconiccontent may be used to indicate the switch function in any operationalcontext, while its colouring and flash pattern may be used to indicateON/OFF status, automation status, critical condition or any otherparameters required by the application.

Optionally, the switch 3 can be fitted with a second set of carbonpills, offset in height to the original. This arrangement allows for thevelocity of the key depression (and release) to be measured, which canbe used as a additional input parameter, for instance if the key isbeing used to trigger a sound, in which case the velocity can be used tocontrol the loudness of the sound. An example of this modified form ofarrangement is illustrated 40 in FIG. 13 wherein two sets of pills 41,42 are provided. Upon depression, a first pill 41 makes contact with atrace on the PCB 8. This is followed by a second pill 42 later makingcontact with a separate trace on the PCB 8.

Although the invention has been described with reference to specificexamples, it will be appreciated by those skilled in the art that theinvention may be embodied in many other forms.

1. An apparatus configured as a virtual user interface, the apparatus comprising: a display screen; a masking element configured to conceal at least part of said screen and revealing at least one preselected display area; at least one user-actuated control element; and a controller responsive to a user's actuating one of said user-actuated control elements and configured to cause displaying information on said display area operatively associated with said one of user-actuated control elements.
 2. An apparatus according to claim 1 wherein one of said display areas is a display window and one of said user-actuated control elements is a switch configured to manipulate information displayed on said display window.
 3. An apparatus according to claim 2 wherein another of said display areas is a switch display configured to indicate the current function of said switch.
 4. An apparatus according to claim 3 wherein said switch display is instantaneously changeable in correspondence with a change in the function of said switch.
 5. An apparatus according to claim 4 including an image conduit configured to convey information from said switch display to a location spaced from said screen.
 6. An apparatus according to claim 5 wherein said image conduit includes a plurality of optical fibres or an arrangement of lenses.
 7. An apparatus according to claim 5 wherein said switch includes a translucent cap adjacent one end of said image conduit for displaying said information from said image conduit.
 8. An apparatus according to claim 7 wherein said controller is mounted on a printed circuit board (PCB).
 9. An apparatus according to claim 8 wherein said PCB forms at least part of said masking element.
 10. An apparatus according to claim 8 wherein said switch is mounted on said PCB.
 11. An apparatus according to claim 10 wherein said switch is depressible mounted on said PCB.
 12. An apparatus according to claim 11 wherein said switch is located directly above said switch display.
 13. An apparatus according to claim 12 wherein said switch includes a silicon keymat attached to said cap, said keymat including at least one primary electronically conductive switch contact such that depression of said cap causes electrically transmissive contact between said primary switch contact and a corresponding base contact on said PCB for activating the function displayed on said switch display.
 14. An apparatus according to claim 13 wherein said keymat includes at least one secondary electronically conductive switch contact at a different height from said primary switch contact such that the velocity of depression of said switch can be measured.
 15. An apparatus according to claim 14 wherein said primary and secondary switch contacts are conductive carbon pills.
 16. An apparatus according to claim 8 wherein one of said user-actuated control elements is a knob configured to manipulate said information displayed on said display window.
 17. An apparatus according to claim 16 wherein said knob is rotatably mounted.
 18. An apparatus according to claim 17 wherein said knob includes an indictor element engaging a sensor on said PCB configured to translate rotational movement of said knob to said PCB.
 19. An apparatus according to claim 18 wherein said indictor element includes a pair of light emitting diodes (LEDs) and corresponding receivers.
 20. An apparatus according to claim 19 wherein one said of display areas is a knob display configured to indicate the current function and status of said knob.
 21. An apparatus according to claim 20 wherein said knob display is adjacent to said knob.
 22. An apparatus according to claim 19 including a light conduit formed by a slot in said PCB directly above said knob display, said light conduit configured to convey information from said knob display to a location spaced from said screen.
 23. An apparatus according to claim 20 wherein said knob is adjacent to said display window such that a portion of said display window closest to said knob is said knob display.
 24. An apparatus according to claim 5 wherein one of said user-actuated control elements is a touch sensor mounted over said display window.
 25. An apparatus according to claim 1, wherein said masking element includes a protective product surface.
 26. (canceled)
 27. An apparatus for a user interface, the apparatus comprising: a display screen; means for concealing at least part of said screen and revealing at least one preselected display area; at least one user-actuated control element; and control means for displaying information on said display area in response to a user's actuating at least one of said user-actuated control element, said control means operatively associated with said user-actuated control elements. 